Skip to content

Capture executed code and result sizes in cloud telemetry - #1727

Merged
RhysSullivan merged 1 commit into
mainfrom
execute-code-telemetry
Aug 26, 2026
Merged

Capture executed code and result sizes in cloud telemetry#1727
RhysSullivan merged 1 commit into
mainfrom
execute-code-telemetry

Conversation

@RhysSullivan

Copy link
Copy Markdown
Collaborator

Follow-up to #1726. Error kinds only catch the loud failure mode; the quiet one — the model not narrowing and returning the whole payload — was invisible.

  • execution engine (shared, numbers only): mcp.execute / mcp.execute.resume spans now carry mcp.execute.result_chars (compact-JSON size of the returned value, pre-truncation; -1 = unmeasurable), mcp.execute.log_chars, and mcp.execute.emitted. result_chars > 30000 marks executions whose preview truncated — the dump-and-read signature.
  • cloud app only: annotateMcpRequest stamps mcp.execute.code (the script, capped at 10k chars) on mcp.request spans for execute/execute-action calls. Lives in apps/cloud, so local/self-host builds emit no content; cloud persists executions for the upcoming execution-history feature anyway.
  • prod-telemetry skill doc updated.

Together with #1726 this gives the full behavioral picture for the output-shape work: guess-and-fail (error_kind), dump-and-read (result_chars), and the scripts themselves to see which one a model chose.

@github-actions

github-actions Bot commented Aug 25, 2026

Copy link
Copy Markdown
Contributor

Cloudflare preview

Torn down — the PR is closed.

@pkg-pr-new

pkg-pr-new Bot commented Aug 25, 2026

Copy link
Copy Markdown

Open in StackBlitz

@executor-js/cli

npm i https://pkg.pr.new/@executor-js/cli@1727

@executor-js/config

npm i https://pkg.pr.new/@executor-js/config@1727

@executor-js/execution

npm i https://pkg.pr.new/@executor-js/execution@1727

@executor-js/sdk

npm i https://pkg.pr.new/@executor-js/sdk@1727

@executor-js/codemode-core

npm i https://pkg.pr.new/@executor-js/codemode-core@1727

@executor-js/runtime-quickjs

npm i https://pkg.pr.new/@executor-js/runtime-quickjs@1727

@executor-js/plugin-file-secrets

npm i https://pkg.pr.new/@executor-js/plugin-file-secrets@1727

@executor-js/plugin-graphql

npm i https://pkg.pr.new/@executor-js/plugin-graphql@1727

@executor-js/plugin-keychain

npm i https://pkg.pr.new/@executor-js/plugin-keychain@1727

@executor-js/plugin-mcp

npm i https://pkg.pr.new/@executor-js/plugin-mcp@1727

@executor-js/plugin-onepassword

npm i https://pkg.pr.new/@executor-js/plugin-onepassword@1727

@executor-js/plugin-openapi

npm i https://pkg.pr.new/@executor-js/plugin-openapi@1727

executor

npm i https://pkg.pr.new/executor@1727

commit: b19d517

@cloudflare-workers-and-pages

Copy link
Copy Markdown

Deploying with  Cloudflare Workers  Cloudflare Workers

The latest updates on your project. Learn more about integrating Git with Workers.

Status Name Latest Commit Preview URL Updated (UTC)
✅ Deployment successful!
View logs
executor-marketing b19d517 Commit Preview URL

Branch Preview URL
Aug 25 2026, 02:10 AM

@cloudflare-workers-and-pages

Copy link
Copy Markdown

Deploying with  Cloudflare Workers  Cloudflare Workers

The latest updates on your project. Learn more about integrating Git with Workers.

Status Name Latest Commit Updated (UTC)
❌ Deployment failed
View logs
executor-cloud b19d517 Aug 25 2026, 02:10 AM

@RhysSullivan
RhysSullivan marked this pull request as ready for review August 26, 2026 22:22
@RhysSullivan
RhysSullivan merged commit e76a9b4 into main Aug 26, 2026
41 of 44 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant